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ABSTRACT 

An instrument has been designed and used to quantify 
the degree of student dissatisfaction with computer-assisted 
instruction (CAI) experiences. The instrument, entitled PERPI-LPI, 
was derived from the service test Perceptions Etudiantes de la 
Relation Prof esseur-Etudiants (Student Observations on the 
Teacher— Student Relationship) , It measures the observed experiences 
and the desired experiences of students on 61 dimensions of 
teacher-student relationships, using a five-point scale. The 
difference between observed and desired responses provides an 
indication of student dissatisfaction. The test was administered to 
35 secondary students who bad taken a CAI course in data processing. 
Results indicated that student^machine interaction needed to be made 
more rapid and flexible and that machine failure could be reduced. In 
addition, it was found that the measuring scales needed improvement 
and that test modules should be constructed so that it would be 
possible to adapt situation specific instruments to appropriate 
contexts- (PB) 
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A. WORK TOOLS 

In vie\'7 of a constant revision and renewal of 
courses, it is important to know the degree of the 
students dissatisfaction with regard to a given 
situation as experienced by them. The consequent 
improvement of this situation could bring about 
increased motivation for learning and hence a better 
learning experience. 

I- THE ''PERPE-LPI'' TEST: 



For these reasons, it seemed desirable to adapt 
the '^PERPE"- service test to our particular needs. 



This test measures (on a five point scale and 
with sixty-one dimensions of teacher-student relations) 
on the one hand, the observed experience (question A) 
and, on the other ^ what is desired (question B) . 



For each dimension, the difference between the 
answers to questions A and B indicates a certain 
dissatisfaction on the part of the student. ''^''^ 

In collaboration with the "PERPE" service, we 
devised, over the summer of 1971, the ^^PERPE-LPI" 
test with about thirty dxTnensions taken directly 
from or adapted from the "PERPE general" test and 
about thirty others created especially in view of 
a controlled C , A . I • Laboratory a x p e r i m e n t . 
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- Perceptions E t u d i a n t e s d e la Pv e L a t i o n P r o f c g - 

seur-Etudiants (Student Observations on the Teacher 
Student Relationship) 

V::'; ef. "PERPE'^ documents. 

Reflexions sur I'ecriture du test PERPE-LPI, 
SENTENI, Alain (intern^-l report). 



II THE EXPERIMENT 



Thirty-five^' secondary V students attended an 
introductory course in data processing for an average 
of fifteen hours at the terminal^ one hour of which 
\^7as sonorized (laboratory sessions \^7ere two hours 
long) . 

At the end of the experiment, the students 
took the "PERPE-LPI" test and their answers were 
processed by the "PERPE" service v/hose programs were 
already in use. 

The results were transmitted to us in the begiiL- 
ning of February 1972 and a rapid analysis already 
allov7S us to predict certain tendencies. 



The "PERPE*' service considered this number 
sufficient to indicate tendencies in a preliminary 
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R. TENDENCIES ACCORDING TO A RAPID ANALYSIS OF 



THE FIRST RESULTS OBTAINED FROM THE "PERPE- 
LPI'^ TEST 



According to "PERPE*', the following results 
are furnished for each dimension: 



- MA: Average of the answers to question A 

- MB: Average of the answers to question E 

- MAB: Average of the absolute differences 

between A and B. 

- MAL : Average of the algebraic differences 

betv/een A and B» 



I GREAT DISSATISFACTION: 



1- What are the dimensioas for which the 

greatest dissatisfaction \-;as indicated? 



On the suggestion of the "FERPE" "Guide d'ana 
lyse du dossier personnel^', wa have chozen from th 
sixty-one dimensions those which had the highest 
percentage of dissatisfaction (table 1). 



Let us consider next the ten dimensions v;hose 
brute rate of dissatisfaction (MAB) is highest 
(table 2)5 then those ten whose net rate of dis- 
satisfaction (HAL) is highest (table 3). 



Through an analysis of these three tables (1, 
2 and 3), we isolate the common dimen::iions which 
yield the table of greatest dissatisfaction (table 
4). 



TABLEAU 1 



DIMElsSION 
NUMERO 


TITRES 


% 


30 


Attentes dues au systeuie 


99 


?.l 


B o u c 1 e s 


89 


. 1 3 


Analyse des re: 'nses 


89 


lA 


Questions ouvertes 


83 


09, 


In f or ma t i oa s complementai- 






r e s 


O i 


29 


Erreurs dc contenu 


83 


19 


Questions suscitees 


80 


31 


Frequence des pannes 


80 


36 


Frequence d' utilisation 






des magnetophones 


80 


50 


Capte I'attention/presen- 






t a t i vm 


80 


51 


Capte 1 ' a t t en t i on/ cont enu 


80' 



TABLEAU 



DIMENSION 
NUMERO 



TIT RES 



30 
15 
21 
09 

36. 

29 
31 
06 
lA 
07 



Attentes dues au systcme 
Analyse des reponses 
BouclGS 

Informations c omp 1 eimen t a i- 
r es 

Frequence d' utilisation 
des magn e t opho n as 

Erreurs de contenu 

Frequence des pannes 

Structure rigoureuse 

Questions ouvertefl 

Informations sur la struc- 
ture 



MAB 

' .AO 
2 , f 1 9 
2.03 

1 . 69 

1.57 
1.49 
1.49 
1.49 
1 .40 

1.37 



TABLEAU 3 



DIMENb LOh 
NUMERO 


TITRES 


MAL 


30 


Attentes dues au systeme 


-2 . 34 


15 


Analyse des reponses 


-2.03 


21 


Bouc les 


-2 , 03 


09 


Informations complemen- 
taires 


-1 . 69 


29 


Erreurs de contenu 


-1.43 


36 


Frequence d ' utilisation 
des magnetophones 


-1.40 


06 


Structure rigoureuse 


-1. 37 


31 


Frequence des formes 


-1.37 


20 


R.eponse aux questions de 
I'etudiant 


-1. 34 


50 


Capte 1 ' attention/presen- 
tat ion 


-1. 31 



(LE SICME INDIQUE QUE, LE PLUS SOUVENT, B 

ETAIT PLUS GRAND QUE A) 
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2- Explanation of table 4: 

Dimension numb er 30 attempts to evaluate the 
length of delays due to the system, the length of 
time required for an answer, the duration of inter- 
vals betXvfeen the students' action and the machines' 
reaction. The students estimated them often to 
very often lengthy (1.97) and would have wished 
them rarely to very rarely long (4.31). 



Dimensions number 15 and 21 measure two aspects 
of the analysis of answers: one (15) measures the 
quality of the analysis, the other (21) the machine 
procedure follox^^ing this analysis. The students 
xvished that the analysis would change from an often 
rough one (2.14) to one seldom rough (4.17) and 
that the frequent loops (2.37) become very rare 
(4.40) . 



In dimension 09, the students indicated 
that they Xvrould like to have increased possibilities 
(from 2.54 to 4.23) of obtaining information from 
machine (either by asking supplementary questions 
or by feedback) . 

Dimension number 29 evaluated the frequency of 
errors encountered in the course material. Having 
rated them as occasional, (3.00), the students 
would have wished them rare to very rare (4.43). 



Machine failure, rated occasional (3.11), should 
ideally be rare or very rare (4.49). 

Finally, the use of audio messages should be 
increased from rare (1.89) to occasional (3.29). 
This result confirms the "Remarks on Students* Attitu 
des toward the Sonorized Part of the Introductory 
Course in Data Proc es s in g » . 



- See the internal report by Lise and Robert 

Patenaude (June 1971) "Les observations sur I'atti- 
tude des etudiants face'a la partie sonorisee du 
cours d'initiation a 1 * in f o rma t i qu e " . Also, read 
"Audio-visuei et Cours automatise" by Michel Thi- 
baudeau (July 1971) . 
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II SLIGHT DISSATISFACTION: 



1 - yha t dimensions evoke the least dissatisfac- 
tion? 

Having eliminated the dimensions v/hich give 
rise to a \7ide divergence of opinion, \*:e singled 
out those which had the smallest percentage of 
dissatisfaction. The same analysis was carried 
out with MAB and MAL which finally produced the 
table of least dissatisfaction (table 5). 

2- Explanation of table 5: 



Two interesting p 


0 in t 


s : the 




ma s t e r y of 


the 


keyboard (dimension nu 


mber 


25) wa 


s 


judged eas 


y ) and 


the use of the cathode 


ray 


screen 




(dimension 


numb e r 


34) rated as very freq 


u en t 


did no 


t 


cause diss 


a tis- 


faction. 












Dimensions number 


53, 


54, 56 




and 60 eval 


ua t e 


the tutor in several a 


spec 


t s , and 




the s tudent 


s in- 


dicated their satisfac 


t io n 


with h 


i 


s technical 


com- 


petence, the importanc 


e of 


his r 0 


1 


e (moderate 


) , and 


his availability (very 


f re 


quentl'y 




ava ilable ) ; 




finally, they found it 


sat 


i s f ac 1 0 


r 


y that thei 


r tutor 



come to see them o c c a s ional 1 y • 

Although the students were satisfied concer- 
ning external noises (dimension nuiTiber 26), judgtd 
rarely loud, it should be noted that the experiment 
was conducted in the evening x\7hen the laboracory 
was not being used by other persons. 



The content of the cours, 



structured (3.37) but ^^^^^^V^'^^ ^^^^^^ moderately 

been satisf ' ''"'^"'^ ^^^"^ ^° have 

satxsfxed by this structure (3.83) 
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DIMENSION 
NUMERO 


TITHES 


% 


KM 


13 


Frequence dcs questions 








f erme es 


97 


0 . 03 


IS 


Memo r i s a t i on 


96 


-0.03 


19 


Questions suscitees 


95 


0 . 06 


11 


Difficulte des excrcices 


85 


-0.09 


35 


Fi-cquence d'ut:'. lisation des- 








documents ecrits 


85 


0.11 


02 


Contenu substant:;el 


79 


-0.17 



PLUS FORTE CONTRADICTION 
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One of the consequences of such contradictions 
is that they produce an abnormally small MAL ; for 
that reason, they were omitted in the study of 
minimal dissatisfaction. 
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III CONCLUSION AND WARNING : 



It seems then that a definite effort should be 
made to improve the interaction between the students 
and the machine, that is, to make the system which 
analyses the students^ actions (students' questions, 
students' answers) both as flexible and as rapid as 
possible. It would also be desirable to improve 
machine maintainance so as to reduce the number of 
sys tem failure . 



The results of this 
of the direction that fur 
these efforts might .inclu 
software and hardv/are. 



study are only indications 
ther efforts should take; 
de changes in courseware^ 



As for the measuring mechanism ( " PERPE -L P I ) , 
the scales for certain dimensions shovild be shifted 
either to the left or to the right; in certain 
cases the hypothesis of equal spacing of points on 
the scale should be tested. For example: should 
the same distance exist between "occasional^* and 
"rare" as between "rare" and "very rare"? 
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C. CONCLUSION AND POSSIBLE DEVELOPMENT: 



A more detailed analysis of the 61 dimensions 
of "PERFE-LPI" and comparison with future experiments 
could help us to improve different CAI procedures, 
either by improving the courses which are used in 
the experiments, or by improving the measuring 
mechanism, itself. The contributing factors in 
CAI being so complex (terminals, supplementary 
material, pedagogical strategies, the context in 
which it is applied), it is difficult to devise a 
single instrument capable of measuring all of them. 
This evokes the concept of a dynamic test which 
could adapt to different situations. A possible 
solution would be a "modular test'' in which each 
"module*' would measure a specific aspect of CAI'^^. 
A regrouping c t several "modules*' would thus permit 
an evaluation of a situation experienced under 
given controlled conditions. These different modu- 
les could be made available by computer to a grea- 
ter number of teachers reaching a greater number 
of s tuden ts . 

A "PERPE" test has actually been devised to 
study the attitudes of students x^rith regard to a 
CMI study being conducted at the Laboratory. 



'5 A module would be, for example, a significant 

Q grouping of five or six dimensions. 
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